BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on ALL-TOTAL events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] ==[ALL-TOTAL]== 3182 ( 1480) 2541 ( 1480) 46.51 58.24 51.72
[JULIELab ] ==[ALL-TOTAL]== 3182 ( 1455) 3068 ( 1455) 45.73 47.43 46.56
[ConcordU ] ==[ALL-TOTAL]== 3182 ( 1106) 1807 ( 1106) 34.76 61.21 44.34
[UT+DBCLS ] ==[ALL-TOTAL]== 3182 ( 1168) 2110 ( 1168) 36.71 55.36 44.14
[VIBGhent ] ==[ALL-TOTAL]== 3182 ( 1062) 2062 ( 1062) 33.38 51.50 40.50
[ UTokyo ] ==[ALL-TOTAL]== 3182 ( 893) 1671 ( 893) 28.06 53.44 36.80
[ UNSW ] ==[ALL-TOTAL]== 3182 ( 898) 1957 ( 896) 28.22 45.78 34.92
[ UZurich ] ==[ALL-TOTAL]== 3182 ( 876) 1895 ( 876) 27.53 46.23 34.51
[ASU+HU+BU] ==[ALL-TOTAL]== 3182 ( 688) 1106 ( 688) 21.62 62.21 32.09
[ Cam ] ==[ALL-TOTAL]== 3182 ( 672) 1181 ( 672) 21.12 56.90 30.80
[UAntwerp ] ==[ALL-TOTAL]== 3182 ( 714) 1501 ( 714) 22.44 47.57 30.49
[ UNIMAN ] ==[ALL-TOTAL]== 3182 ( 702) 1444 ( 702) 22.06 48.61 30.35
[ SCAI ] ==[ALL-TOTAL]== 3182 ( 826) 2278 ( 826) 25.96 36.26 30.26
[ UAveiro ] ==[ALL-TOTAL]== 3182 ( 666) 1351 ( 666) 20.93 49.30 29.38
[ Team 24 ] ==[ALL-TOTAL]== 3182 ( 721) 1778 ( 720) 22.66 40.49 29.06
[ USzeged ] ==[ALL-TOTAL]== 3182 ( 685) 1852 ( 685) 21.53 36.99 27.21
[ NICTA ] ==[ALL-TOTAL]== 3182 ( 555) 1388 ( 555) 17.44 39.99 24.29
[CNBMadrid] ==[ALL-TOTAL]== 3182 ( 903) 4362 ( 903) 28.38 20.70 23.94
[CCP-BTMG ] ==[ALL-TOTAL]== 3182 ( 428) 596 ( 428) 13.45 71.81 22.66
[CIPS-ASU ] ==[ALL-TOTAL]== 3182 ( 725) 3809 ( 725) 22.78 19.03 20.74
[ PIKB ] ==[ALL-TOTAL]== 3182 ( 358) 538 ( 358) 11.25 66.54 19.25
[ UMich ] ==[ALL-TOTAL]== 3182 ( 966) 6860 ( 966) 30.36 14.08 19.24
[ Team 09 ] ==[ALL-TOTAL]== 3182 ( 372) 1184 ( 372) 11.69 31.42 17.04
[ KoreaU ] ==[ALL-TOTAL]== 3182 ( 299) 485 ( 299) 9.40 61.65 16.31
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] ==[ALL-TOTAL]== 3193 ( 1136) 2110 ( 1136) 35.58 53.84 42.84
[ASU+HU+BU] ==[ALL-TOTAL]== 3193 ( 625) 1106 ( 625) 19.57 56.51 29.08
[UAntwerp ] ==[ALL-TOTAL]== 3193 ( 680) 1501 ( 680) 21.30 45.30 28.97
[ Team 24 ] ==[ALL-TOTAL]== 3193 ( 704) 1839 ( 703) 22.05 38.23 27.97
[CCP-BTMG ] ==[ALL-TOTAL]== 3193 ( 423) 596 ( 423) 13.25 70.97 22.33
[CNBMadrid] ==[ALL-TOTAL]== 3193 ( 786) 4362 ( 786) 24.62 18.02 20.81
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ConcordU ] ==[ALL-TOTAL]== 3617 ( 1168) 1943 ( 1168) 32.29 60.11 42.01
[VIBGhent ] ==[ALL-TOTAL]== 3617 ( 1096) 2229 ( 1096) 30.30 49.17 37.50
[ASU+HU+BU] ==[ALL-TOTAL]== 3617 ( 710) 1185 ( 710) 19.63 59.92 29.57
[ NICTA ] ==[ALL-TOTAL]== 3617 ( 572) 1450 ( 572) 15.81 39.45 22.58
[ USzeged ] ==[ALL-TOTAL]== 3617 ( 720) 3113 ( 720) 19.91 23.13 21.40
[CCP-BTMG ] ==[ALL-TOTAL]== 3617 ( 445) 777 ( 445) 12.30 57.27 20.25